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Description 

The invention relates to a method for the search of 
motion vectors for a video signal to make use of motion 
vectors in video signal processing applications, such as 
video signal compression. In the method, an error value 
is calculated for at least part of the image blocks on the 
basis of each motion vector candidate to be used, and 
the motion vector candidate producing the smallest er- 
ror value in each particular case is selected as the mo- 
tion vector of the image block. 

There are more and more video signal processing 
applications that require information about the motion 
contained in the image. Examples of such applications 
are video signal compression methods employing mo- 
tion compensation and motion-compensated line fre- 
quency or sampling raster transforms. Each image is 
usually divided into smaller blocks each having an as- 
sociated motion vector. This vector indicates the direc- 
tion and speed of the motion of the image information 
contained in the block. 

Typically, to find motion vectors for an image, a so- 
called block matching method is used, in which each 
block of a current image is compared with the blocks of 
a reference image within a certain search area. From 
among the reference blocks, that minimizing the applied 
error criterion (typically the Mean Absolute Error MAE, 
or the Mean Square Error MSE) is selected. The differ- 
ence between the positions of the current block and the 
selected reference block gives a motion vector for the 
block. 

JP-A-32171 84 discloses a motion vector estimating 
apparatus employing the block matching method for 
providing block matching values which represent likeli- 
hoods of motion vectors with respect to an actual mo- 
tion. The block matching values are weighted by respec- 
tive convolution adders. The smallest of the output val- 
ues from the convolution adders is selected and output- 
ted as a final motion vector. 

Compression applications employing motion com- 
pensation require the transmission of the motion vector 
of each block in conjunction with the actual coded im- 
age. Typically, the motion vector of each block is not 
transmitted as such but only the difference between the 
motion vector of the current block and that of the previ- 
ous block is transmitted, that is, the motion vector of the 
previous block is used as a predictor for the motion vec- 
tor of the current block. Before transmission, these dif- 
ferences are further VLC (Variable Length Coding) cod- 
ed so that the shortest code words correspond to the 
most frequent differences. In view of the coding of the 
motion vectors, it is advantageous if the differences be- 
tween consecutive vectors are as small as possible so 
that the number of bits required for the transmission is 
also low. 

The search for the motion vectors will be described 
more closely below with reference to the attached Fig- 
ure 1 . 



The blocks for which motion vectors are to be found 
are typically small in size, e.g. 16 * 16 pixels. In normal 
image Information, an image portion having substantial- 
ly the size of one block very rarely moves in a direction 
5 different from the direction of the neighbouring blocks. 
In other words, individual divergent motion vectors are 
mostly due to errors committed by the vector search 
method. Accordingly, a more homogeneous vector field 
usually corresponds more closely to the motion actually 
taking place in the image. 

Motion vectors may be used as a selection criterion 
for the subsequent processing of the image in coding, 
for instance. Motion -adaptive or motion-compensated 
pre- or postprocessing may be performed on the image, 
and the motion vectors found for the image can be used 
to facilitate the choice of the way of processing, e.g. to 
decide whether the block is processed as two separate 
fields (assuming there is motion present in the block) or 
whether the fields are combined into a single image 
(thus obtaining better results in stationary image areas). 
It is thereby usually preferable that the vectors are as 
short as possible and that there does not occur any sud- 
den deviations in the vector directions. 

In most coding applications, motion vectors are 
used to find a predictor for the image to be coded from 
among the previously transmitted images, in addition to 
which the formed prediction error is transmitted. There- 
fore incorrect motion information is not visible in the im- 
age as individual errors but deteriorates the image qual- 
ity indirectly over the entire image area. 

On the contrary, in motion-compensated line fre- 
quency transforms and in motion-adaptive noise remov- 
al, the effect of incorrect motion information becomes 
directly visible in the image as clear errors or as an in- 
ferior quality of a desired function. Therefore it is of pri- 
mary importance in such applications to obtain correct 
information about the motion taking place in the blocks. 

As appears from the above, the applications would 
often provide better results if the motion vector field as- 
sociated with the image were as homogeneous as pos- 
sible without any individual divergent vectors and if the 
vectors were as short as possible. 

The object of the present invention is to provide a 
vector field more homogeneous than a vector field ob- 
tained by the conventional motion vector search meth- 
ods so that the above-described problems are alleviat- 
ed. This is achieved, according to claim 1 , by means of 
a method for the search of motion vectors for a video 
signal to make use of motion vectors in video signal 
processing applications, such as video signal compres- 
sion, said method comprising the steps of: calculating 
error values representing error between a current image 
block in a current image and reference image blocks se- 
lected on the basis of each of motion vector candidates 
of the current image block, weighting the calculated er- 
ror values by respective weighting values, selecting the 
one of the motion vector candidates resulting in the low- 
est one of the weighted error value as the motion vector 
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for the current image block. The method is characterized 
by the further step of determining each of the weighting 
values on the basis of the respective motion vector can- 
didate and/or a ratio between the respective motion vec- 
tor candidate and motion vectors, if any, previously se- 
lected from its neighbourhood for obtaining a more ho- 
mogeneous motion vector field. 

The basic idea of the invention is that the motion 
vectors of image blocks located in the neighbourhood 
of the image block are also allowed to affect the selec- 
tion of the final motion vector of the image block in such 
a way that the advantage to be obtained from the ho- 
mogenization of the motion vector field is greater than 
the disadvantage caused by a possible increase in the 
matching error value. 

In the following the invention and its preferred em- 
bodiments will be described in greater detail with refer- 
ence to the examples of the attached drawings, wherein 

Figure 1 illustrates the search of motion vectors by 
a block matching method known perse; and 
Figure 2 is a block diagram illustrating an equipment 
implementing the method according to the inven- 
tion. 

Figure 1 illustrates the search of a motion vector by 
a block matching method known perse. A block 10 to 
be compensated is compared with blocks 12 of equal 
size within a search area 1 3 in a reference image. The 
size of the search area 13 as full pixels is determined in 
accordance with the terms x_max and y_max. A match- 
ing error is calculated between the blocks 1 0 and 1 2 ac- 
cording to the applied error criterion. The vector is then 
changed by one pixel, and an error value is calculated 
for the block corto the vector. The error value is com- 
pared with the previous value, and the vector having the 
smaller error value is selected as a current motion vector 
candidate. The search is continued over the entire 
search area 1 3, and so the final motion vector of the 
image block 10 will be the vector having the smallest 
error value within the search area. 

As the comparison of the blocks is a heavy opera- 
tion, methods have been developed in an attempt to test 
only part of the motion vector candidates. This can be 
accomplished e.g. by testing a few vectors of different 
directions and then performing the search more thor- 
oughly around the vector which gave the best result. 

The search of the motion vector may also be per- 
formed with an accuracy greater than one full pixel. This 
is done by making the sampling raster of the reference 
image 13 more dense by interpolating new pixels be- 
tween the original pixels. In this way, the search of the 
motion vector can be performed with a desired accura- 
cy. 

It is also possible to perform the search for the mo- 
tion vectors by first applying a transform (such as the 
Fourier transform) to the image and then searching for 
correlation peaks in the transform domain. Typically, 



such methods produce a number of motion vector can- 
didates, from among which the best is selected by block 
matching with a desired selection criterion. 

However, motion vectors derived by the above-de- 

5 scribed block matching method cause problems, which 
will be described below. 

In the block matching method, the search of a mo- 
tion vector is carried out completely independently for 
each block, that is, the vectors of the other blocks do not 

10 affect the search in any way. Even though the desired 
error criterion can be minimized by this method, the 
method does not contribute to the formation of a homo- 
geneous vector field in any way. 

Noise present in the image causes problems in sta- 

15 tionary image areas of uniform image information. Sev- 
eral blocks in different portions of the search area give 
an almost equally small matching error value, and even 
if there were no real motion present in the image, the 
noise may cause a fully erroneous, even long vector 

20 pointing in an arbitrary direction to be found for it. 

The MAE and MSE error criteria used frequently in 
block matching have been selected mainly because 
they do not require any complicated calculation opera- 
tions. Even with these simple error criteria, the block 

25 matching is such a heavy operation that IC circuits per- 
forming the block matching at video rates have been 
commercially available only for a few recent years. 

For example, in the hybrid Discrete Cosine Trans- 
form (DCT) coding (a combination of a spatial DCT and 

30 a temporal DPCM coding), which is today used widely, 
a prediction block taken from the reference image from 
a position indicated by the motion vector of the block to 
be coded is subtracted from the block to be coded. The 
DCT transform is applied to the difference image so ob- 

35 tained, and the obtained DCT coefficients are quantized 
and VLC coded. The number of the obtained DCT coef- 
ficients and thus also the coding efficiency depend on 
the difference image to be transformed and thus also on 
the used motion vectors. The MAE and MSE error cri- 

40 teria do not at all minimize the number of bits formed in 
the DCT transform or the formed final error in view of 
the human eye. 

As mentioned above, the method according to the 
present invention aims at achieving a vector field more 

45 homogeneous than a vector field obtained by the con- 
ventional methods so that the vectors of the neighbour- 
ing blocks also affect the selection of the final motion 
vector of the block. At the same time one aims at favour- 
ing the shortest possible vectors. 

50 The method will be described in the following with 
reference to Figure 2. A motion vector candidate to be 
tested is applied to a block search unit 21 , which search- 
es an image stored in an image memory 22 for a block 
corresponding to the vector, and the block is then com- 

55 pared with an image block 24 to be matched in an error 
calculation unit 23. The operation performed in the error 
calculation unit 23 calculates an error between the block 
indicated by the vector and the block 24 to be matched 
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by a desired method (e.g. MEA or MSE), and then for- 
wards the error information. In the method according to 
the invention, the error is weighted in an error weighting 
unit 25. The error is corrected by a mathematical oper- 
ation, e.g. multiplication, by means of a value generated 
by a weighting generator 26. The final error value is ap- 
plied to a comparator 27, in which the error is compared 
with the smallest previous error and the vector giving 
the smallest error is finally selected as the motion vector 
of the block to be matched, and the resulting vector is 
forwarded. 

The weighting generator 26 generates an appropri- 
ate weighting value for each vector, depending on the 
length of the vector and the relationship of the vector to 
the vectors selected from the neighbourhood. The 
weighting value is thus such that it increases or decreas- 
es the error value associated with the vector in a desired 
direction. In applications where the motion vectors are 
transmitted by the DPCM technique by transmitting only 
the change of the vector in relation to the previous vec- 
tor, a vector identical to the previous selected vector is 
given a high weighting value. This vector can thereby 
be accepted, even though the error value calculated for 
it exceeds slightly that of some other vector. 

In many applications it is important to know whether 
there is motion present in the image. A zero vector (the 
block of the image memory 22 having accurately the 
same position as the block 24) indicates that the image 
is stationary, and this information may be used in many 
image processing methods. The amount of misinterpre- 
tations caused by noise can be reduced substantially by 
giving the zero vector a weighting value which reduces 
the error value associated with the zero vector. 

In addition, various applications employing motion 
vectors may benefit if the vectors are confined in a cer- 
tain area. Such an area may be provided with its own 
weighting, which is possibly combined with the previous 
weightings. 

A weighting value may also be used to favour vec- 
tors occurring either in a spatial or temporal neighbour- 
hood, possibly in combination with other ways of weight- 
ing. 

The method according to the invention may also be 
realized as post-processing of an existing vector field. 
This will be described below. 

At the first stage, a motion vector minimizing the ap- 
plied error criterion has been derived normally for all im- 
age blocks by using the entire search area. A finished 
vector field has thus been obtained. At the second 
stage, error values are recalculated for each block by 
using both the motion vector originally derived for the 
block and the motion vectors selected for the neighbour- 
ing blocks. As the number of cases to be tested is not 
high, the calculation of the error value may employ a 
more complicated error criterion than the testing of the 
entire search area. For example, the MAE criterion may 
be used in place of the MSE criterion. 

The obtained error values are weighted by a weight- 



ing value generated by a generator corresponding to the 
weighting generator 26, and the vector producing the 
smallest final weighted error is selected as the motion 
vector. The length of the vector and its effect on the ho- 

s mogeneity of the final vector field affect the weighting 
value given to the vector even in this case. 

Accordingly, no new motion vectors are derived at 
the second stage, but the motion vector of the current 
block may be replaced by the vector of a neighbouring 

io block if the advantage to be obtained from the homog- 
enization of the vector field and the shorter vectors is 
greater than the disadvantage caused by the greater 
matching error. 

A simple situation where the motion vectors of only 

is the current block and the block immediately preceding 
it are examined is discussed as an example of the 
above. Assume that V c is the vector of the current block 
and V p is the vector of the previous block, resulting from 
the first stage of the vector search. Assume further that 

20 E c is the matching error produced by the vector of the 
current block, and E p is the error produced by the vector 
of the previous block according to the MAE criterion. In 
this example, the same error criterion is applied at the 
first and the second stage of the search, so that E c and 

25 E p are also used in the selection of the final vector. The 
selection of the final vector may be done e.g. in the fol- 
lowing way: 

3Q V p long, V c short -> the final vector is V c 

V p long, V c long, E p < k*E c -> the final vector is V p 

- 

35 

V p short, V c short, E p < k*E c -> the final vector is V p 
V p short, V c long, E p < kTE c -> the final vector is V p 

40 

In the example, the vector lengths are divided 
roughly into two main classes only: long and short vec- 
tors. The value of the coefficients k and I is greater than 
one. In the example, one thus aims at using the vector 

45 of the previous block whenever it is not too long and 
whenever the matching error produced by it is not too 
much greater than the matching error produced by the 
vector of the current block. 

The method according to the invention may be uti- 

50 lized in all types of motion vector searching methods. 
First, it can be used in a normal way to accomplish a so- 
called full search covering the entire search area. Sec- 
ond, it can be applied when using various accelerated 
search algorithms, in which the entire search area is not 

55 tested, but only the most promising portions of the 
search area are tested by various approximations. Sim- 
ilarly, it can be utilized efficiently in the search of motion 
vectors with an accuracy greater than one full pixel. 
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Even though the invention has been described 
above with reference to the example of the attached 
drawings, it is obvious that the invention is not restricted 
to it, but it may be modified in various ways within the 
inventive idea disclosed in the attached claims. The s 
search of the motion vectors may take place e.g. by 
means of several increasingly accurate searches, in 
which one attempts to increase the accuracy of the vec- 
tor by iterations. It is also possible to search for the mo- 
tion vector candidates e.g. by a method based on the 10 
phase correlation. Even though the above description 
refers only to a method in which an error value is calcu- 
lated on the basis of each motion vector candidate to be 
used for at least part of the image blocks, and the motion 
vector candidate producing the smallest error value is is 
selected as the motion vector of the image block, it is 
also possible to calculate correlation values in place of 
the error value, and to select the vector associated with 
the highest correlation value as the motion vector. As 
the method according to the invention is equally appli- 
cable in such a reverse basic situation, the wording of 
the attached claims has to be understood to cover even 
this kind of variations. 

25 

Claims 

1 . A method for the search of motion vectors for a vid- 
eo signal to make use of motions vectors in video 
signal processing applications, such as video signal 30 
compression, said method comprising steps of 

calculating (23) error values representing error 
between a current image block (10,24) in a cur- 
rent image and reference image blocks select- 35 
ed on the basis of each of motion vector candi- 
dates of the current image block, 
weighting (25) the calculated error values by re- 
spective weighting values, 
selecting (27) the one of the motion vector can- 40 
didates resulting in the lowest one of the 
weighted error value as the motion vector for 
the current image block (1 0,24), characterized 
by further steps of 

determining (26) each of the weighting values 45 
on the basis of the respective motion vector 
candidate and/or a ratio between the respective 
motion vector candidate and motion vectors, if 
any, previously selected from its neighbour- 
hood for obtaining a more homogeneous mo- so 
tion vector field. 

2. A method according to claim 1 , characterized in 
that in the selection of a new vector the weighting 
value favours the vector selected last. ss 

3. A method according to claim 1 or 2, characterized 
in that the weighting value favours a zero vector in 



relation to other vectors. 

4. A method according to claim 1 , 2 or 3, character- 
ized in that the weighting value favours the vectors 
according to their length. 

5. A method according to any of claims 1 to 4, char- 
acterized in that the weighting value favours vec- 
tors located within a certain area. 

6. A method according to any of claims 1 to 5, char- 
• acterlzed in that the weighting value favours vec- 
tors occurring in a spatial neighbourhood. 

7. A method according to any of claims 1 to 6, char- 
acterized in that the weighting value favours vec- 
tors occurring in a temporal neighbourhood. 



20 Patentanspruche 



Verfahren zur Suche von Bewegungsvektoren fur 
ein Videosignal, urn Gebrauch von Bewegungsvek- 
toren in Videosignalverarbeitungsanwendungen zu 
machen, wie beispielsweise einer Videos ignalkom- 
pression, wobei das Verfahren die folgenden Schrit- 
te umfaGt: 

Berechnen (23) von Fehlerwerten, die einen 
Fehler zwischen einem aktuellen Bildblock (10, 
24) in einem aktuellen Bild und Referenzbild- 
blocken reprasentieren, die auf der Basis jedes 
Bewegungsvektorkandidaten des aktuellen 
Bildblocks ausgewahlt werden; 
Gewichten (25) der berechneten Fehlerwerte 
durch entsprechende Gewichtungswerte; 
Auswahlen (27) des einen der Bewegungsvek- 
torkandidaten, der in dem niedrigsten der ge- 
wichteten Fehlerwerte resultiert, als den Bewe- 
gungsvektor fur den aktuellen Bildblock (10, 
24); 

gekennzeichnet durch den folgenden weiteren 
Schritt: 

Bestimmen (26) einesjeden der Gewichtungswerte 
auf der Basis des entsprechendeh Bewegungsvek- 
torkandidaten und/oder eines Verhaltnisses zwi- 
schen dem entsprechenden Bewegungsvektorkan- 
didaten und Bewegungsvektoren, falls solche vor- 
handen sind, die zuvor aus seiner Nachbarschaft 
ausgewahlt wurden, urn ein homogeneres Bewe- 
gungsvektorfeld zu erhalten. 

Verfahren nach Anspruch 1, dadurch gekenn- 
zeichnet, da6 bei der Auswahl eines neuen Vektors 
der Gewichtungswert den zuletzt ausgewahlten 
Vektor bevorzugt. 
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3. Verfahren nach Anspruch 1 oder 2, dadurch ge- 
kennzeichnet, daB der Gewichtungswert einen 
Null-Vektor in bezug auf andere Vektoren bevor- 
zugt. 

♦ 

4. Verfahren nach Anspruch 1 , 2 oder 3, dadurch ge- 
kennzeichnet, daft der Gewichtungswert die Vek- 
toren entsprechend ihrer Lange bevorzugt. 

5. Verfahren nach einem der Anspruche 1 bis 4, da- 
durch gekennzeichnet, daft der Gewichtungswert 
Vektoren bevorzugt, die innerhalb eines bestimm- 
ten Bereichs angeordnet sind. 

6. Verfahren nach einem der Anspruche 1 bis 5, da- 
durch gekennzeichnet, daG der Gewichtungswert 
Vektoren bevorzugt, die in einer raumlichen Nach- 
barschaft auftreten. 

7. Verfahren nach einem der Anspruche 1 bis 6, da- 
durch gekennzeichnet, da3 der Gewichtungswert 
Vektoren bevorzugt, die in einer zeitlichen Nachbar- 
schaft auftreten. 



Revendlcations 

1. ProcSde de recherche de vecteurs de mouvement 
pour un signal video, destine a utiliser des vecteurs 
de mouvement dans des applications de traitement 
d'un signal video, telles que la compression d'un si- 
gnal video, ledit procedd comprenant les etapes 
suivantes 

calcul (23)devaleursd'erreur reprSsentant une 
erreur entre un bloc (10, 24) d'image en cours 
dans une image en cours et des blocs d'image 
de reference s6lectionn6s sur la base de cha- 
cun des candidats au vecteur de mouvement 
du bloc d'image en cours, 
ponderation (25) des valeurs d'erreur calcu- 
I6es, par des valeurs de ponderation respecti- 
ves, 

selection (27) de Tun des candidats au vecteur 
de mouvement conduisant a la plus faible va- 
leur d'erreur ponde76e, en tant que vecteur de 
mouvement pour le bloc (10, 24) d'image en 
cours, caracterise par les etapes supplemen- 
taires suivantes 

determination (26) de chacune des valeurs de 
ponderation sur la base du candidat respectif 
au vecteur de mouvement et/ou du rapport en- 
tre le candidat respectif au vecteur de mouve- 
ment et des vecteurs de mouvement, s'il y en 
a, prec6demment s6lectionne a partir de son 
environnement, afin d'obtenir un champ vecto- 
riel de mouvement plus homogene. 



2. Precede selon la revendication 1 , caracterise en ce 
que, lors de la selection d'un nouveau vecteur, la 
valeur de ponderation favorise le vecteur seiection- 
n6 en dernier. 

5 

3. Precede selon la revendication 1 ou 2, caracteris6 
en ce que la valeur de ponderation favorise un vec- 
teur zero par rapport a d'autres vecteurs. 

f0 4. Proced6 selon la revendication 1 , 2 ou 3, caracte- 
ris6 en ce que la valeur de ponderation favorise les 
vecteurs en fonction de leur longueur. 

5. Proc6d6 selon I'une quelconque des revendlcations 
15 1 a 4, caracterise en ce que la valeur de ponderation 

favorise des vecteurs situ6s a Pint6rieur d'une cer- 
taine zone. 

6. Proced6 selon I'une quelconque des revendications 
20 1 a 5, caracterise en ce que la valeur de ponderation 

favorise des vecteurs apparaissant dans un envi- 
ronnement spatial. 

7. Precede selon Tune quelconque des revendications 
25 1 a 6, caracterise en ce que la valeur de ponderation 

favorise des vecteurs apparaissant dans un envi- 
ronnement tempore I. 
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